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ABSTRACT 

The idea of reaucing the redunQincy c£ a terbal 
message in a statistical way is preieiitca as a iraciicea iechnigue of 
language testing* considering the tispoxality of speech 
conprehension* and the necessarilj S46qtt€ntial intake of iDforffiation^ 
these cues aty include the serial order of eleients and tiansitional 
probability, give the backgrQuna o£ reaucea redundancy teats, tbt 
contruetivist of listeulng coapxGlensicc ia outlinea as a 

creative, active cognitive operation with B^veral iniplicitiensi (1) 
it means that processing is facilitated by tbt ling viatic and 
pragBatie organiaation of the message, tog€ther with its iceaentation 
in context I (2) it iniplies that Besory, espeGially ^bdrt*1ertt 
storage, an essential part of coniprtjhensloni and |3) it iaplies 
that the nativ# listener is oiily partly bound by the prcFCctdcs of 
the signals he receives* Two rsducea r€ducdarcy techniques of 
listeninq coapwhension testing are re?ieif€d that present the learaer 
with ©essaqes that do net contain all the inforoatiec ih^j normally 
carry* In the noise test and the aural cloze test, the lisrner r^eeds 
to mobilize his total awareness of the linguistic anfl pragmatic 
structure^ Preliwinary cbservations en an eaperiaental test of aural 
cloze with Finnish learners imply that the tests have initructional 
value and may have a stronger theoritical basis than the completion 
tasks ttaaiticnally used to measure listening fcr details, jKCR) 
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TESTING LISTENING COMP^^HKNSION THROUGH REDfNDAs^CV KtlDUCTlON 



1. IntrodUctAun 
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The tdtia of reducing the redundancv of a verbal n^s^^a^e in a 
statistical way is by no n^eans a novelty in language teFtmg. 
It has hitBn utjed at Least since informatior thaery baga- to have 
an effect on readabUity ineasurement, and, m consequent.^ . nn the 
measurement of individual differenoos in native-language reading 
comprehen^iar. ekill (Taylor 1957| Bormuth 1962). In language 
description, information theory w^m refieeted in the efforts to 
characterise language in terms of transiticnel probability - i.e. 
the likelihood that a given language iter^ will be follow-sd by 
certain others. Such rro^sls of language- structure can now be 
ihown to be inadequate in. comparison with the hiararchieal 
elegance of generative descriptions. Vet it seemi that sor^e of 
the testing techniques in current use are ba^ed, in part at least, 
on just these probabt lis tfc viewe fwitneas the widespread interest 
in gap-f il ling) . 

One possible reason for this is tne recent trend in the study 
of language pDrformance / whi ch emphasises the dimension of tine 
and the dynamic use of ?LnowiGdge in ^lurception and production 
(Marslen-Wil^on 197S| Wold 1§76), zvon though the language user's 
competence is probataly best deHcrib^d an ateriporal hierarchical 
system, his perforniance alway?; inv^clv-iH n serial Qv€nt spread over 
timfe. In perception, this torrporal sequence, the succession of 
speoch nignals, is translated into an atemporal pl^n or perceptual 
schujTia . In Pr-^duction^ tho -lircction is the cpposit!= . c^bviouslv, 
atempcral conipetence is tht) basis of perfGnrance. The listener is 
not, hQwev.jr, ''a LranHformational Unnuist crying Lo map a sentence 
'-nt'Z :i vjrar-n=aL i^a L Lhc.rj"' w^'^-aI^n = Wilson i97b;i27j. Therefore 
his perforrtiance may alas be ba-sed on a heuristic utilisation of 
whatever cues he may find in the signal. Considering the tem- 
porality of speech comprehanBion , and the necessarily sequential 
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intake of information^ theee cues may wall Iriclude the serial 
ord€r of elernents and transitional probability* Perhaps it is 
this fmct that makes for the underlying eenneGtion between sonie 
preaent-day lanfuage testa and such concepts as Information, 
raQundancy* probafcility, and predictability. 

in this paper^ an attompt is first made to outline compre^ 
h<in^^tQn as a creatiVe,^ ccnstructive activity, and to discuis sone 
ef the implications of this view, especially as regards redun^ 
danay utilisation. NeKt, two reduced redundancy techniquei of 
listening comprehension testing are reviewed* Finallyi a few 
preliminary observations on an aKperimental reduced redundancy 
listening comprehension teat are offered^ 



2^ fhe backfro-ond to reduced redundancy tests i the eanstruetivist 
viev of listening compreheneion and soine ©f its implicationi 

According to the "eanstruetivist" view, speech comprehension is 
an active cognitive operation- The sensory data, received during 
a fast and holistic stage variously referred to as ^'feature 
detection* or "seniation** (Massaro 1175), "sensing" (Rivars 1975), 
or the ^•preattentive stage (Keisser 1566), are stored for a brief 
peried in an echoic mernory structure. The constructive process 
begins iimnediately with the synthesising of perceptual units (e.g. 
syllables ) from the sensory data. Those portions of the ipeech 
wave that fail to fit Into the auditory synthesis are Lejected 
as irrelevant noise, and do not come to the listener's attention* 
The process continues with an active traneforination and reduction 
of the information into a verbal, meaninfful form* This trans- 
formation is made possible by the store of linguistic information 
in the listener's lonf-^tetm memory , The resulting string of 
recognised words is stored in the short-term "working** memory. 
Rehearsal, which has been described by Rivers (1971 il26) as "t*ie 
reGirculating of material through our cognitive lystem" , is 
necessary before the meaning of the message can be derived: it 
keeps the perceived string of words 'alive' in order that they 
my m related to other pirts of the utterance through a further 
process of recoding. In this furthiic abstraction of the infor- 
mation, words arc eon*lned into phrases, phrases into , clauses, and 
so on* ftieoding - *chufikir.g% as Miller (1J56) calls it - is thus 
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assuJiied to he tho process thrQugh which the rreaninga of larqer 
units beconic- a v.i i 1 1 n to ^ho llHtGner, It c^m be ehounht of as 
a repeated procodH thLit recluci-B, say, a string of words into 
successively rrcj.ve ab^irract, r^t^iMungful itorr.s f'*chun>'5") in the 
working memory. Th^ deri\*ation of the mejining of -tonger stretches 
of speech would not be possible without this ron tructuring, since 
the capacity of the working memory is limited. As a result of the 
rehear sa 1,/rDeod in g = working memory loop, information La finally 
placed in long-term storage in forms radically different from 
those in which it was originally perceived. Sentences^ for e5<= 
ample, lose their Burface characteristics, and their meaning is 
stored in some kind of deep=s tructure form (Nelsser 1966) Rivers 
1975; V^anner 197^U Massaro 1975), 

Speech comprehension is a communiea tive act^ and conimunication 
takes Place in real time. Because of this temporality, it seems 
that models attempting to account for ordinary compreiiension of 
continuous discourse will have to incorporate heuri-stic strat- 
egies, and to assurr.e that higher-level processes {syntax, seman- 
tics, context) are involved from the very beginning. One such 
strate^y^ based on this idea of simultaneous and parallel process- 
infi is redundancy utilisation. It may be defined as the listener's 
capacity to make systematic hypotheses about the content and 
structure of the message. This capacity has its basis in the 
linguistic and pragir.atic competence of the listener, and it enables 
him to"^ construct projective hypotheses from earlier information 
and to evaluate these hypotheses utilising subsequent data,^ The. 
listener's kno^^/ledge of communication situations tells him what 
is likely to be said in the given situation. Further, his knowl- 
edge off syntax tells hin what to expect if, for example, he hears 
a question word at the Lc/g inning of a sen'rence. Similarly, he 
knows th^ phonological rules concerning permiBsible sound se^ 
quencesf sind these rules facilitate word recogn ition by intro- 
ducing redundancy nn th^ phonological level, cind so on. The 
important thing is that the utilisation of redundancies at differ- 
eric levQls of lanfjUayD is a simultaneous und parallel process, i.e./ 
that coritprehension porformance Is integrative. 

The constructivist view has several implicat ions . First of 
all f it means that processing is facilitated by the llnquistic and 
pragmatic organisation of the message, together with its presentation 
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in context. The msre explicit and clear the structure, the greater 
the eimount of rodiindancy m the mossaqe, and the easier the compro- 
hension task. Similarly, if the uttoranco is tied to a sufficLent 
conttixt. It 4g likely that ^wmprehensivn will hu t-nhancod through 
expectations and a psychological set that effectively quides the 
listener's attention^. It araanisnticn c l the iTat^'vial and Its 
presentaticn in >rcntL;xt arv insportant aids to lan-r-;-uH' K^'ocesc^ing 
by nativ<os, tney arv- all the mfjro ii!;pcrtant for the u^reiqn languaqo 
iearner, wr.ose rr^a^tt^ry of the new linuuistic sy^zit ii iy still be 
rolativ^ly ; nr--.ple , !^ati'/e speakers talking tr I a mors arc 
intuitively aware of this, and tend to avoid ^pe.nkinn in ways that 
would make the Drganisation of their message less evident. Prag^ 
matLc orqanisation of the material is particulariy irpcr-ant for 
the processing that takes place in a language learnirig situation/ 
since it increases the learner's opportunities for utLlising 
redundancies that are not language-^speci f ie . 

SeccndLy, the constructivist view inplies thatVer^rVf es- 
pecially -n^rt.^Lerrt stiorag^^^ is an essential part of comprehension. 
Short -terr "wcrking*" ron'ory is known to have a^ lirited capacity', 
but since it operates on tne principle of hierarchical recoding 
("chunking"' , its capacity can be extended. The listener's 
generative ccrpotence, which allows redundancy utiliBation, also 
accoun^^ i:r ;is aLility to recode verbal natorial for retention 
in tne /^^rkinc: r-onory. The retention of a certain arount Of 
previous content is necessary for the generation of anticipatory 
hypotheses. Eimlarly, the " right- to-left " clarification of 
unclear or ambiguous points in the message also requires the 
s tor ago of fairly extensive sequences. As the native listener 
masters the categories of his language, he is able to "chunk" the 
message according to these cate 'ories. As a result, he is able 
to hold large amounts of contej^t in his working mernory/ and to 
utilise this context while anticipating or clarifying ^arts of 
the fnessage. The L2 learner, however, has an inperfectly de- 
veloped mastery of the categories of the language, which 



Psycholinguistic ry^edrch on tliu effects of organisation and 
context on comprehension, meniQry ^ and learning has been reviewed 
by Oiler {1372) and Kohanen (1975). 
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presumably reduces his ability to handle data in ^hort-term 
storage, ^lumn -xpurimentH that suggest a connocti^n lotwoen L2 
skill and sli'M^t-tcrm memory are described i>\' L.ul - 1970) and 

Harri.3 (1^70), m has aeen shown, for oxnmpio, u.at ^hort-terni 
memory eapacLty l,; graater for Ll than for i ; r^ateriaU that L2 
BQntQncQ meniury .^pan is affected by cercain .irTUit: i cal variables 
to a larger e>:Lonr than the 14 ripan; and tiuit :j ^ !;.; r t- tt rr; memory 
teBtB corroUte rM-HSonabiy woll with typitral : nl t iple^choice tests 
of liBteninq eonipr^honsion and granmar, Th.> lisoly explanation for 
theEe L2 re^ult^ thdt the learner lacK^ E-r n.i-ivc speaker'^ 
fuU capacity for effective cecoding. Thcreuuv, his capacity 
to handle L2 data in the working rriemDry is lir-Lted, and this is 
reflected in both comprehension and iJroduction. 

Looking at the active processes of comprehension and redun- 
dancy utilisation from another angle, a third impiication of the 
constructivist view is that the nati%^e listener is only partly 
bound by the properties of the signal he receives. in" ordinary 
communicatLon, Che listener must actively ccnstruct the nessage 
for himself. One reason for this is that ^pc^i^n disccurse is 
often highly fragmentary and elliptical. The clarity of the 
message may also be reduced because of psychol ^aical or even 
physiological performance limitations either in the speaker or 
in the listener. The channel of communication ray earrv a 
considerable aniount of noise, competing mcssjiges, and so on. The 
presence of some kind of disturbance is the rule rather than the 
oxception in normal communication. Under such circumstances, a 
purely "passives" comprehenHion system, entirely dependent on the 
stimulus, would in fact be an impossibility, 

The abiliLy of the competent native listener to process non- 
ideal messages was efficient Ly demonsLrated by the early experiments 
with acoustic speech distortion.. The experimenters used filtering, 
amplitude selection, time compression, ncise addition, and a 
v^ariety of other techniques. The general findino was that 
continuous speech is highly resistant to distortion (see Miller 
r)51;, Tf>e explanation for ^-hjs was f-und in the high redundancy 
Of languacre, i.e. the myltipMcity -uc:: prT^;icnt in the mossage. 
According to Lho constructivist view, another equally crucial 
factor is the rocons tructi%-e power of thi- naLive listener's 
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competence. In the ease of the L2 learner^ this creative redundancy 
utilisation cjapacity ia norrnally mDvo restricted. 

5. Two reduced redundancy tcHts of listening coniprehonsion 

3.1. General ron.arks 

The centriil point in tlic ctMistructi vUc viuw of cumprGhension is 
thus the active contribution of the listener. He puts the mes.^ag© 
togecher for himself^ workny simultaneously at ail leveli of 
language etructure^ and utilising whatever linguistic or extra-^ 
linguiBtie cues there rruiy ho in the message, in order to arrive at 
the iTieaning as quickly as possible. Such an integrative capacity 
for redundancy utilisation can even be thought of as a central 
factor underlying much of language us^ (cf. Kolzman 1967^ Oiler 
1976}. According to this view, a convenient way to get an overall 
c^stiirate of the L2 learner's skills is to present him with messages 
tiha^ Jn not con tZi in all the inf;:rn^ation Lh^y nc.irtTiai;'.y carry. The 
rosult - a reduc^i'd redundancy cest ^ is integrative in rtiuch the 
sarr.e way as language uso itsQlf is tntiegrative . In euch teste , 
the learner need^ tc mobiliye iiis total awareness of the L2 
linguistic and pragn.atic dLr'Jcture. lie us^es that structure in 
r%'<ing hypotheses about tho content nt the n<3ssage. His rerory 
capacity is also involved, ^inco iTiemory is necessary for both the 
ma!< i ng and ve r i f :< ca t ion of the so ny po t hoses * 

2.2, The "Noi#€i Test" 

In a ianguage testing contoxt, the tirst svBteinatic experirnents 
v/ich noiBo addition wore carried nut :<t Indiana I'niversity by 
Spoisky et al, (1968^ see aii.;o Spolsky l^'T]; 1015), At Lund 
university, the technique h^s been usoci by Johansson {1912) 1973). 
Furth»:/i- investigations of it:^ character iy tics as a FL test include 
Orddn^n (i973j -^nd Gradman s JpOi/i?iy {1^)1^}. SOTT^e ^new deveinpnont 
in the oontuKtual 1 : It ion rf »heBo to^.tB navo boon reported by. 
Seiigor A Whitoson (IV^/D), White:u.n fj-v:), nnd Galo!) ot nl. (1077), 

The term "nosse tost" nas cone to irf for to the reduced 
redundancy lisLeninq tests enpLoyod by those testers. In this 
type cf tQst^ the H-jhjoct h^^'arr^ ^entencijs rLxod with white noist^ 
(a hissing sound In which the f requen^' lr>s ot a wide frequency 
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raricjt? .no tnjually repreBunted) . The sentences are uBually 
uneoniu/.' t t'l! . Thn nank ^jf thc^ togfcoe is to rt?produce the t^ont ontH'S 
i n w fit ; n •- ? /i a c c u r a t v 1 y an po k £5 i b 1 1» » Thus, t Ii c- noise 1 1? ^ t i 
CHi-c;^ 1 ; j I 1 y dictation tr-st whcro tho ontirt- r.L ^ina^e r^Ui^ti L^c 
pro Cv'r^ for bot h coiTiprehenB ion and verbji t i n' rpproduc t i on , and 
whcM^o tho main omphasls ig on intensivo listoninq^ In its use 
ot t?s?i'rnal distortion* it is related to thoso tost^ of (usuallv 
f;f ijn H i vc } cornprcjhtfns ion where authentic matu'rials {^troot 
intervigws tigainst; traffic noLse, for ext^mple) are used, but the 
noisc tost represents an attempt tn control the level of reduii- 
dancy reduction. .The testee*o proficiency can be stated either 
In terms of the signal--tO""n3ise ratio with which he achieves a 
givdn level of accuracy, or in ternis of His compreliension score 
at a fixed level of distortion^ 

The preliminary nxperiments by Spolsky et al* v/ere concerned 
mainlv with the practical arrangements required by the technique^ 
It Was found that an adequate scoring system for the dictationB 
can be developed, and that the noise can be added without too much 
difficuity, ai though the use of various si^ynal^tc-^ noise ratios 
demands electronic compressing of the signt^i . In addition to the 
nol se-plus^dic ta t ion technique, a rnultiple^ehoice variant has been 
U3ed (Gradran 1973) ^ In which the testoe selects his reeponees 
froin 5 alternative sentences. In general ^ the noiee test appeared 
reasonably viable. However, the technical aspects oi its 
construction can be complicated ^ and the continuous presence of 
disturbing hiss may be found objectionable by sorre testees, 

Spolsky (1971) and Johansson (1972) agree that the test 
appears reliable even in its dLctaUion form. The jrultiple^^choice 
vers L on used by fir ad man had a Kudejr = Richardson reliability indeK 

0 t ,68 ( ^* = 2 5 ) s Wl 1 e n the test wa a g i ve n to o ve r six h u nd re d no n ^ 
n.at ive speakers of English, its reliability reached .92. The 
mu] t i ple^choice Vfirsion wan foiind to cnrrelate at over *80 with 

t hf die ta t i a n ve r n i n n * i \\ «. i i c a 1 1 n g t h a t there wo u 1 d be some grounds 
for using the administratively r^oro efficient and objective variant 

1 n 3 tfi fid o f t he s uIj j uc L l ve 1 y sco rod d 1 c ta t ion ( Gr adman h Spol sky 
1 '37 . 

Mn r" t of ♦=h*^* f'H ^"if^MR n i f-.n around nf^isn tentD of * he above type 



8 



has eentsed on the validity of th© technique. Its construct 
validity as a reduced rodundancy test is fairly q<?neral]v' tirrrr'tcd* 
Some diffet**ncGS of opinion ^t^om to txist about t=nipiric,jl v.ilulity, 
id£itimdtt;d thrcugh rre lat ion?i beLwut;n i.ui^^ t<-Ht& urul .;thtr 
mDaBurt?^? "1 L2 proficiency. The final form of Spoluky*H urinirial 
(1968} t^dt ^3rrolatod .it ,Cb ;SpCarran's rhg} v.'ith a Jiain^Hti^ 
tost of listening ccT\prol\unH ion f At with :in c-h^or'r \ vi> 

discrtpta^pc mt grarnnuiz tf^nt, nnd at .51 with iin eBS^y \K = ) . The 
continuation of thtJBt? t^KpeririGntS reported by Gradrnn (1^3) and 
Gradrjin ^ Spoluky prcduced rcac::r;^),;ly high cof f i e i*j n 1 1 

both v/ith oral int-3EView^ (.79 and ,S9j N - 25,26) and with the 
totals of the TOEFL battery (.75 and .66, respectively). With a 
cest rTK:.delled on Spolsky's original, Whitf?son (1972 ) obtained a 
*54 correlation betwet^n noise test results and a proficiency test 
developed at Cambridge Univorsity (N ^ 12). The contextual 1 sed 
type of noiBe test (Seliger and whlteson 1975) correlated at .69 
(N ^ 61; with a tost based on the Cambridge Proficiency Exair, 
Johansson 15 72; 1973) reports a ,52 correlation wtth what is 
teriTi^d A. ^^sjst ci .jnnoral Kngii^^h prof jc iunoy il972i399) ^ a 
wriit^?^ ^e'^rt with ^ number of rx:?lntB where tYi'? testee chooBes 
the Bynt^c: ical ly right one from 2-3 alternative forrnulat ionB . 

The 4 nter pre tat ion 14 of those figures differ considerably, 
Spoisky and Gradm/jn think tluit the noise test is a promising 
r=eaaur-e :f rilohal L2 proficiency. Gradran ( 1 073 ) hopes that it 
nay ai;!-:- to replace the functionally oriented but subjective 
interview. u"oh/*n.Sfe5on » however, comes to the conGlusion that the 
noise t^st is net a valid itrt^asure of L2 QVorall skill. 

i Although Johansson' b test of general English proficiency may 
not be entirely adequate as a criterion, the correlations do not 
on the whole Beem to warrant the cTOnclunion that a valid eBtimate 
of L2 Bkili could be based on noise ti?Bts alone. At bt-.-st, the 
noiiiU toBt seemM to account for Bome "iO per cent of the variance 
in a traditional proficiency battery. It ib alHo fairly easy to 
agree wi r/h Johansson that the noise test - as rather a Bpecial 
kind of liBtening test - is likely to ornphasise psycholoqlcal and 
oven phyeio log leal factors such as hearing ability and ability 
to disreqcird extefnal distur bailee when concentrating on a task. 

A second point of interest related to validity is the 
relationship between the noise test and dictation a*^ integiative 
llstonlnfi tests. Although Johansson's low correlation bet w<;en the 
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fioise test and a test of listening cornprehension (.20) in part 
rt'SuilK from tho low rUBcrimination power c^f the formor, thg fact 
iov\:\ir\Y\ thilt dictation without noif^i^ c. rriMaf*^d cons idornbly 
I'i'iiui With list^niny CQjnpry it^ii u&i; - Ju;. Tiit; Lrorireldtion 

.'}3 in - 71) oijtained by Gradman nna ^poU^kv U^'^S) betwoon 
-i.ctjticn With ht?^vy distortion and i . :i t. u-n w^tn niniral distor- 
ts .^n ^ dB) :{lso indicatas 'i.at dici.;:i.'r^ o.^ulJ ho usod 
=.ionc, frueh a Johanfison fi u-gyt^ s t , .U uiri .in .1:%! iUvl^kv do f one] thp 
u^t- ijf noii^c by :^i;iyincf that m.-^^^kcs Jit difiuiL^i l5:vvls of / 

t^jr t i;;n r^-/ I dificrt^nt, that £urth^^^ 1^ tho 

ust? o.*^ nois^c could give useful information ^on how linguistic 
uriits relate to lavele of redundancy roduetion. These questions 
Afo certainly interesting for interliinguage analysis, if one 
wants to use die tat ton methods m tostmg L2 nkili^, the tradi^ 
tional undistorted e^^ereise WQUid, however, seerr. simpler and 
nor 5 straight forward, especially as it also contains a strong 
L-odundancy utiLisation element {cf= Oiler and Streif 1375)* 
Pec;ently Gaies, Gradn^anf and SpolBkv [1977: 5ft ^ have m fact corne 
i\.;unu to Johan^^'^n* ^ ^1972 ) viow, and state tr^jt "t^\^ use of back^ 
yrovir^d noise ef^K^^g *--q h.^v^ h^d little ^^ffr^et on T^e r^eaajreront 
Di: overall English prof icienoy *' for their students. 

The fact ti^it isolated dentencQs have nornally teen used in 
n?;5e tests alKO Jiiriinishes tiioir validity as in£ej;rat ive neasures 
rz iiHtpninr! fro f 1 c u^ncy . C.:3n text ua 1 1 sa t ion of these to^ts (the 
use of a continuous tent in a lifeline situation, c.n. a eon^'er^ 
s fit ion between two airline I'^insengery with jet whine in tlie back' 
jriiund) is c^rtai.nly a desir^^LIo ir^ rwver:u?nt iSeliaer find 
Wniteson 197^^ cf, also Gaie^s ut al. 1077). K^weve?ri it seems a 
little dubious whether even this inoroased "realism" can avert 
i^oKtile attitudes in Studuntf^ taking suoh test.^ on repeatt^d 
occasions. /.nd since thtJ addition of noise aeer.s to muke 
relativeiy little difference in th^^ rersults, its value as a 
i^ysteniatic redundancy reduction tool m intensive listening tests 
rcjnain^ unprovon . 

Aurnl clo^e 

lite ciu^i^ pr'ucdaro, orl^itiauud Ly Ijylor (lO^i) a roadnbility 

ritt^a^ure and Hubsequennly used by native and foreign language 

toiaters as a reading con'prcii^nr^lun test, a 1 ^^o lends itself fairly 



easily to reduGed redundancy testing of listening skills. One 
pcssible r-cthod is lo usv unmut t latf-d listening paBBnno ^r.a*^rhov 
Wi-n ^ riozo-rutil^tod t r.-iniUT 1 Pt on which the tusLe?oj? mar); tht-ir 
rs^pon^qs after listening (Oakc'tUiOtt-^Tayl^r l^iVC; ct, .il'^-i U-Ji^vd 
u ^:cr■dstr^n 1376). The fillinq of the gaps may also hv donr n 
jpc^iiod ^t.jt sirjlJlc- t;:^- ^c^^l tiro liritH of spok-ni ^^ ■y'r^^.:- 1 - 
ratiisr. An;:t-n^r variant ihi8 tf,-chniqu^' i JohanHH!-'?i ' • "jMili.il 

d:,,;tJi^Lcn" .1^73^, in which v^u^v^ .iro ini^ortod at ,i t :i i ■ 1 puicijs 
after O-Jc;:; -|ap for tno Htudi;nt to fill in tho missing fortiori f 

written cloze made easier by the preceding or p^irtly simul tcinpcsus 
presence of the original information in dural form. 

A HomewhaL iTiort? aurLil teglmique is the present^it ion of a 
iLs^enlng passage or dialogue that is interrupted at certain times^ 
when the testoe is asked to choose the continuation from a set of 
vr 1 1 ^.tjn a 1 1*? ma t i vq 5 . t\\ i produces a to s t of the ab i 1 i ty to 
u t ^ i ^ 3e p r u V i o as co n ce x t i n '* p re d i c t i %*e listening" ( !i ug he s 1974). 
:= T^ay a nea^Uft^ of botn eKtensive listening, including 

jrfji.^^ , .n;d r.crcr dot,"i*lod i-^ints of language structure and usage* 
7no nr-^taLcr^ inher^^rit m iti^ni eonstruction are perhaps componsated 
f:^r i;7 quick and reliablp scoring, 

7n<^ original Ldr>a of the cloi^e [procedure as a systematic 
redusrticn redundancy through MLatistieal deletion can also be 
■^pp.i'^d taped aura* i^esfe^uiyett . A qiVL:n ntretch one second) 

icouaLic inforrrwi t icn nay be e?^cisod at regular intervals and 
replaced by silence* Another possibility is to base tl^e deletion 
on iLn^uistiv unif^, w-r:!^ or long^^r segments. Although the latter 
prcwodure may he criticised on phonetic grounds, the aegmenting 
c an , howe vq r , be tlon e re 1 a t i ve I y easily and with an accuracy 
sufficient for mear^tiring th*' tostees' expectancies of the lingujs^ 
ttc features mvoived. 

Jioth the noiso test ^'Ud aural cio^e of the word^deletion type 
can probably be ch.i racter i nod ns intensive listening tests. They 
are Lntegrative m tne sense that boLh continuous acoustic distortion 
and the random dcietian of words, result in an even spread of 
redundancy rnductj.Qn over different Unquistic features. Short^tfsrm 
memory pUys a similar role in both type^ of test, and beth of them 
require fairly quick reaction in the use of languago, as is appro- 
priate If, u test connected with oral c;oru^un i cat ion , Verbatim 
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reproduction, however, inora iir.portnnt in the die tat ion- type 
hOiso tijBti if the r'/'i'j I r*'itk;iiE of vurbatin' reproduction ig dropped, 
thv: ^jcoring of sorant i 1 I y acct-ptrih lo al t<.*rnat i vf:>i i^oon bvcom?^ 
probiematic Aural cloze niorc easily acored according to 
contextual criteria, .ind n.dy thu^ givo nore omphasis to adequate 
con^pr^hengion * Althcu'ih uurii .-laze II. ru^t v.^rv far ror^o^/od fron 
aictation in Chc sOiiL^e truit it rer|uirOJ thu- bL.ui-iit lO taku dawn 
partK of the n^o^sayts ir niay iii^mnnd a noro .iclivt' arui crt^ativcr 
utilisation of rodundancios thun the noi^a dofs* 

Written cio;:^ has bo^n :]ubjOijtod to uxtcnHi\-u ^fa^uarcYi , but 
relatively littlt- can be found about aural clo^e as a testing 
tMchnique, although its uee was suggested by Taylor as ear'ly as 
the fifties (Taylor 

Dickens and Williams (1964) describe an experiment in which 
two aural cloze tests were given to native speakers of English 
(N ^ 127, 126), The tests, in which the reduction Of redundancy 
ccinsisted in the del ct ion of one word every S seconds, had split^ 
half rel iahi 1 1 t ies of .SO and .70, and correUited with each other 
at .73, The scores were found to correlaLe at .52 and ,49 with a 
tjunerai test of Kngiish language ability, These correlations were 
olriost identical with those obt^iirwd betw^'^^n the language abilitv 
test nnd two traditional tests of llstoning comprehension, Howcveri 
jccording to the authors, aural c ] OLte appea red r^ore reliable. The 
reliability and validity of aural cl^^:::^ a5. a f o re 1 gn^ 1 an guage test 
were further investigated by Greqo ry-ranOf:ouios (1 066), whose tost 
contained 12ft iterr'S (deletions of every ^^th word from parts of a 
locturei , with tho raxin^un '\ i A itjlufiionK £:ar ^en tenco . Verbatim 
scorm^j was usvd with i.^me oKcen t ic-na , TesL-retest reliability 
was slightly over .DO tn tho two aduU subject groups (N - 47), 
and thu test whr found *:c C'^=rt'- late a I v;itn a stanclardisod 

listening comprehension tust, and at wiLh the Ca] ifornia 

Hoviding Test, Thu author con^;id^-i^ clc^e to be a mor*^ dirQct and 
reliabh' n ea-^ajr*^ o f o r^:- i qn - 1 q go jistr-ning cnrrprehenslon than 
the traditional r ul C i p 1 jh . ; co t'^st=s. Nutter's (197.1) study of 
the ef foots of diffcrt^nt dvbjtien rjtf*.^rns and other rcchnical 
variaLioni. in Lii-j j-roc-Hhir'^ i lui i ea ^ - -1 , not h u rpr i s i ng i v , that 
rei Labi ii Lie^ afiU diLLicuLty ar*^ aiiecLud by such factors 

as passage type, cUfrer^aii "oth-ds of nreson ta t ion , and deletion 
patterns, TejTip 1 ton ' [Vn ') t-U, given t-. a group of 3^ adult ' 




foreigTi students En^U^h, ha^ a reliability of o^eff »90. 3t 
correlated best i^ith t ho ^ur^l ,^i'Qciori of a pioCiciency battery 
(.3C/, while the lowcs t e^We^U^ clon obtained wlTh the voeabu^ 
lary section ( .54) . 

The- aural t;lf5^e t ^3st^ m^nt >on^ti above ha-vo dispUyed qui^e a 
terar^;^£.Ie rDliability . ^lu ^ m^y in part be consneetod v/ith ttie 
facw tnat it LS ia^riy ua^y to r-iakts a cioao L^st that aontains 
a largo nurr^er of'lt^^m^, Th^ir construct validity iB again bagod 
en -ne ^dass language ^odund^rtcy and conitjuociv^ coiripteherision. 
As far as emptrtcaL va lid5.ty le coric&rnedi TejnpletQri' s results, 
for ixar.ple, scein prQm.islng* M^re worl^ should^ rio«everi be 
earrif?d o^t on tha qu©stic>n v^hac exactly ts involved in a 
te-i^ r- ; this typ^i i.^ ' wTietner it can be called a ^ost of generaL 
12 pr^fLciency/ a listening ^om^rengnsion test, a voesbulary ^yis, 
or I m Templetoh's phr^asa (1^77 #2&S), a test of *'gp<ptting the 
hlQ&u" . Ths nent aOQt ion of this paper deals with som^ of theeo 
quts^iirs in a \^cry pt^lir^in^ry way. 

4* A^r4l elo2e witS. ri finish ^oa^tfner'Bi soirw tontativ^ results 

a&ne proliminary e>^per inents witfh .^ural clam mro carried out 
in ^^'^fi-T at the P^psr^fi'Qnt ^ngilshf Univejesicy of turku, in 
crder find out vhe trier an in^ontfiv^g listenint test eoui d be 
d^ve> w^d that WQuLd have a ^tt^ng^r ^hecretteal ba^te than tHe 
compI^tLon tasKs ttadi tioriall^y ijmd to measura listenit^Q for 
•i^tails. It was ft^lt thac iri m#ny casts the eomplatioti 
m existing listentng ^cmpreb^en^ion ^5<ercises and t^sts we r-j 
written because it ha4 ba^n ^iftficult to construct cnoiagh SGnslb^e 
nultipia-^hoiee qu^sti^ns fo^ tvie exercise to usable ot the 
t^st to be reliable, ^he id^a jredunaaney utiiisatiesn saemed 
to off^r a suitably ba^kg^our^cl tfor the aevelopinent of such 
intensive listening material^ ^he Hkill of intensive ilst^nlrtg 
was looseLy defined .as the^ a^il^ty to concentrate or% the langwg@ 
used to eKpress the^ cor»t:*^nt ^he passage. *Xhe task the 
student in the test cari b^ s^id to include mst of Hughos* {lp?0 
categories of Ustvnia-j sktilj^s C^t iQast prerticti-ye^ r%trofipacfcive# 
constructive, and mvnn intfer^nfci.al listening) , but the finpriasi.i 
here was on langijaQ^g s^ru^tuire* thus the aim the t%st 'v^'a^ not 



tc ityeasura hew well the itudent could follow the general lines 
of axgyjnent in an aural inessage, or how well he could eKti'aet 
Ijifo xmation from the passage and evaluate this inforrnation ^ 
althougrh this wider type of cornprehension is not doubt Involved 
1.^ intensive liitejung as w^ll. An integrative type cf languag© 
proficiency te^f wa^ Aimed atf but it was assumed that results 
would be affected by the fciet that the test was specifically a 
listening test. 

Aceordingly , a nun^er of aural cloze tests based on the 
deletion of words from taped monoioguei (originally either leripted 
radio talks or written passages snodified for oral presentation) 
were adJninistered to fi^t-year studrnts of English, and a group 
of native British secontlarV'Virhool sc^dents^ So far, ^detai led 
results are available for the first of the experimental EFL tests. 

the folloirfing some general observations about this test are 
given. 

The test consisted of 72 items, with the omisiion of every 

10th word as tho deletion principle. The deleted Words ware 

replaced by splioing in a quiet eleetronia signal of constant 

l^ngeh (1 sec*). Th© following extract illustrates the type 

o tf text used^i 

*^ ^ W'ell, I'm a professional writer^ and ^_ I was 

younger I thought a typewriter would he ~ I even 

thought it was necessary, and that editors and _ 
would e?€pect anything sent to thein to be typewritten^ 

. I bought mysolf a typewriter and taught myself 

to . And for sonie years r typed away busily. 

But . _ __ _ didn't enjoy typing. I happen to enjoy the 
act o f _ . _ ... 

(adapted froni Spencor^ D.li. ^ Inal is_h for Prof iciencv^ 
■ OUP 1 963. ) " 

Iri tHiu ejcper imerit ^ unlike the subsequent ones # the subjects were 

not allowed to listen to the mutilated passage beforehand. Their 

tasK Was to reconstruct the passage on the basis of onlv one 

h^afing, and to write down t.heir completions on an answer sheet 

eith^)- during listenj.ng or during pauses that were inserted at 



'Ths- teHtg selected contained a considerable aniount of ridundaiicy 
In'^nhe form of repetition, as can be seen from the extract. In 
sonte te^tSf the amouiit of redundancy "Was increased by shortening 
the iente^nctfs (converting ernbeddings into short main clauses, for 
O'xanijie), or by inserting reforniulations of words^ etc. ^ Occa- 
Bisn.aliy the context between two gaps was shortened or lengthened 
by ojie word owin^g to such phonetic reasons as reductions in weaJc 
f orm^. , 
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suitable Byntaatie bDundarlee, moetly between ientences. 

The rospcnse data were processed using the CLOZE computer 
prcgram (see KonoTien ^ Salmela 1977) , and the Bubjects' completions 
were evaluatad according to both verbatim and conte^ctual criteria, 
In th© latter scoring ^ which was done by a native EngllBh speaker* 
§ .^oripletion was courited (xb correct if it fit; ted th^? conteJ^t up to 
the end of the last sentence hQ^rd, An item analysis was cnrried 
out using the OPSAM progrism (Mikkoncfil. Mikkonen 1971), TnhlQ 1 
gives some of the iteni analysis reBults- 

TABLE 1 , ITg_M_^AXYS_rS OF AN EKPERimmM. _AV ml S 

n;d of items ^ 72 



12 3 4 



scoring 40% ^80 56 178 I) ,82 

-intextual scoring 54 % ,84 65 (90 I) ,8S 



1 - average solution percentage; 2 ^ reliability (internal 
ssnaistency) of the entire 72-item test^ 3 - nurfcer and 
(percentage) of tterns with an item correlation > *O0^ 4 - 
reliability of test with items mentioned in 1, 

ks was expected, the test in this forin (only one hearing) 

protyed rather difficult » An interesting result V3.s the relatively 

sn'^ll differentie between the average solution percentages on the , 
i 

two scorings. iThis was due to the scoring criteria used in 1976* 
since parapiire/ses of several words were not accepted in this 
ccntextual scoring. The criteria have later been irodifiedj and 
this will probably increase the difference between verbatim and 
conteKtual percentage^, A second listening* employed in later 
^cetir^gs, also rrakes th^ task of the testee soinewhat easier. It 
rnay foe seen that %hm xe I'i abi li ty of the test was relatively 
hiqh even before any items had been removed on the basis of the 
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item correlations . ConteKtual seoring is aeen to be statistically 
worm effective, besides boinq Intuitively a more proper way to 
assess foreign languayc elo^o responses (of. KohoncJh 1976, whoso 
findings in an EFL written cloze test were HinUari» The general 
observation from the itom analysis is that Uin ..'^perlmcntal aural 
cloze test provoa to be a fairly reUauie inHt r urriGnt , and it is 
probable that tho changes introduced m the KCfji inq criteria will 
further diminitUi the nuinber o^f disct^rded items. 

The previous resoo^rch reported above seems to indicate that 
reduced redundancv tests of tht^ type have reasonable empirical 
validity, ln;Order to yee how the test perforrried in that respect, 
the scores were correlated with the subjects* scores in the 1976 
Joint Entranc© Exam (arranged by Turku together with three other 
university Departments of English}. 

TABLE 2, CORRELATIONS BETW EEN AURA L CLQZE AND THE 1976 
JO INT gNTRANCE EXAM 

N ^ 48 





1 2 


3 






0 


6 




verbat im. 

•J 


.15 .49^ 




, 17 




.28 


.11 


.49^ 


contextual 


.10 .^1" ^ 




. 24 




.34 


.22 


.52* 



1 - lecture conprehensisn ; 2 - Listening comprehension^ 3 ^ 
reading comprehension; 4 ^ v'ocabulary; 5 ^ grammar; 6 = "verbal 
reasoning" (linguistic inferences froin artificial lanfuags data) i 
7 - total of sections 1-^5. Asterisk - significarit beyond the 99 
per cent Level of confidtncB, 



In the analyuis. Items Cdn be discarded according to a pre-determrned 
level -ot itotT. c Drrelatioru N'ormaliy, zero correlatior. is a suitable 
cut-off point for small populations such as the prtsent group. - If 
one einploys the rere stringent criterion that a "good" item must 
corrQlate with the total sc-ore the per cent level of confidence, 
^about half ot the itenB (31, le* 5L i) are functioning well with con- 
textual scoring. The corresponding figure for verbatin scoring is 2S 

3S I). This reflects the typical characteristic of cloze tests 
that they contain relatively m^ny items that are either too easy or 
too difficult, and the fact thae cont-jxtual scoring functions better 
than verbatim scoriiig. ' 
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As may bo seen from the table, the product^inonitnt correiations are 
not quite as high as in sonie of thi eKperiments reported earlieri 
however/ some of thtem are statistically significant beyond the 1 
per cent risk level, and the correlation between aural cloze and 
the English skilli total (seetions 1^5 of the Entrance K>carr) seems 
high enough to warrant further use of the tORt. Since the teit 
population represented the top candidatoy in the ontrance test, 
the variance in their ontruince tust results is relatively sniall, 
This is thus one factor that in fact prevents the' correlation from 
attaining a particularly high value. 

The gorrelatians in Table Z must be treated with the usual 
caution/ but perhaps they pernut some Bpeculattons about what kinds 
of skill are invoH^ed in aur.il c^loie. Contextually scored aural 
eloze correlates best with aural comprehenBion . This section 
contained several items testing "predictive listening" ^ multiple- 
choice conipletions of dialogues, testing the utilisation of pre^ 
ceding context both extensively and from the point of view of 
usage and Idioms. The correlatior\ between contextual aural cl'OEe 
and l^ecture coiiiprehonsion , the other hand^ is the lowest of the 
set. The lecture questions concentrated on measuring the acguisi- 
tion and even application of inforn'ation contained in a taped 
lectuire. These correlations may perliape be taken as an indication 
that aural cloze is more ccncorned with intensive than extensive 
listening, and that it 13 nore a test of languag^^ structure in a 
wide sense than a test of following the argumentation in an aural 
fnessage. The differences between the rest of the correlations are 
too small to justify proper coirjnents. However, it may be a sign 
of the integrative nature of aural close that its correlations 
with reading and listening comprehension - both of them integrative 
tests - are somewhat higher than its correla t ioris with the discrete^ 
point grammar and vocabulary sections. Possibly one could also 
speculate that the mastery of gramriarj, and of language structure in 
general, is at least as important as the rere knowladge of vocabu- 
lary in tests of this type. 

' Uq doubt the reduced redundancy tests described abov'e ^ the 
noise test ^nd aaral cloze ^ involvG a considerable element 
specific to listening. It is thus difficult to say whether they 
would suffice alone as n^asures of L2 praficiency, even if a suitable 
combination of statistical factors were to produce high coefficients 
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of validity* As subtests in proficiency batteries thty seem to 
ueeful, Gradjnan dnd Spolsky M97S), for example^ think that 
th^ noise test can cover an unattended area between f unc tional ly 
oriented interviews and discrete^point measures of profieiency^ 
Ab far can be told from the present preiimlnary results, aural 
cloie may b§ even more interesting as an i ntegr.i t ivc but structured 
tostf since it contains a considerable element of creativity, and 
may thus serve as a more eftective indication f^f the loarnor's 
fluency than the notsdc test* 

The role of "local redundaney" (Carroll 19721 ib obviously 
iinportant In^ aural (and written) clozes most of the items tend to 
measura the utilisation of short-range constralntB. However, this 
is by no rneana an unimportant aim of language learning (cf. Enkvlst 
and Kohorten 1577), and exercises or tests of this intensive ability 
therefore seem justified* But the fact that local redundancy is 
central in n^ny cloze tests n«ans that they can hardly be employed ' 
as tjie teat of L2 comprehension. The more extensive aspects of 
listaningi sueh as separating the essential information from 
unimportant dotail (Hughes' "redundancy listening") are probably 
beat ifieasured by mul tiple-ehoice and related techniques. 

One disadvantage af aural cloze of the above type is that 
only restrictQd kinds of material can be used. Another technical 
difficulty is chat the mutilation of an aural message introduces 
the somewhat irrelevant task of "spotting the bleeps"* and keeping 
the exact locations of the omissions in m±nd. This can be remedied 
in part by telling the subjects that they can write down not only 
the missing item but also soma of its immediate context. 

On the whole^ the completions seern to produce fairly interes^ting 
insights into how learners process spoken text. The fact that it is 
the -weaki^r students who tend to get maxed up is explained by their 
imperfect redundancy utilisation '^rapacitvi rraking hyporheses about 
the CQntent of the gaps takes so long that inadequate time is left 
for rehearsal , As a result, parts o'f the information vanish from 
the working nemcry, and the content and form of t!ie messaQe are 
inadequately processed. The more fluent learner, on the othe^ hand, 
is capable of quick recbgnttion of the linguistic features in the 
m*eESage; Inis fluency eilso makes for efficient hypothesis-generation . 
and quick recoding.^ This leaves more time for rehearsal/ and the 
reproductiDn of the content as well as the form of the message is 
easier. 




The fAft# validity of the reduced redundanGy tests mentioned 
abovs should alio be briefly commented on, as it may be the most 
i^zszant thing to the "layman" taking the test. The intentional 
preaef.ce of distorting noise is hardly likely to make the test 
"seen right" to the testees, As far as aural cloze is concerned, 
sirAiar doubts are expressed by some testees about the relevance 
of gap^filling — an indication that the connection betv/een redundaney 
utiiisacidn, as n^asured by cloze, and communication, may not be im- 
mediately recognisable. Un the other hand, th& majority of students 
In the experiment deseribed above, and in the subsequent testings, 
considered the test intoresting and valid in the sense that it 
. iqaires imaginativeness and a fluent gerteral mastery of the language. 

It is of course desirable that the teste given to ^.earners 
should also have some instructional value* The idea of redundancy 
utilisation is clearly not confined to tests only* It is inherent, 
for example, in the use of authentic materials for extensive listening 
practice* A redundancy reduction element is contained in all exer" 
CLStis where normal rates of- delivery ^.re used, where there are several 
sp€ay*ers engaged in spontaneous conversation with normal amounts of 
bsz>. grourid noise, etc. Anticipatory listening, a central feature in 
reduced redundancy tests, can be practised in class by interrupting 
tne presentation of the exercise tape at certain places and asking 
students to suggest and evaluate possible continuations. The kind 
of aural close that was described above can probably be used at 
advanced levels as an exercise for increasing the J^earners' L2 pro"^ 
cessing capacity. According to Godfrey (1977ill8}, such an increase 
would follow from "piishing the learner to do more with the utterance", 
i*e. involving him in structured active deep-level processing* Given 
the time limits inherent in spoken communication, this would force 
the learner to make full use of his chunking and working nemory canaC" 
ities. He would thus in fact be creating "extra" processing tim.e, 
which could be channeled into rehearsal (for better retention and re^ 
call) and further recoding (e.g* relating discourse segments to each 
other} , In aural cloze the listener is actively engaged in conitruc^ 
tion that is typical of real comprehension, and the generation of 
hypotheses about missing items involves deep-level processing of the . 
!f<essage, l*he fact that the elusive spoken message must be attended 
to in depth may be one reason why students normally find aural clo^e 
exercises fairly interesting and instructive^^ 



I am grateful to Viljo Kohonen and^'Keith Battarbee for comments, 

1Q 



REFERENClSl 



Barmuth^ J* 1961, CJLozo TastB as Measures of Fseadablllty ^nU 
Comprehension A bilTSy ^ DTas , , Indiana Univorsl ty * ~ 

Carroll I J^B* 1972. Defining language coirpreh€?nsion i Borne 

speaulationB^ In Freedle, R.o. i Carroll, J (Eds*), 
1-29. 

Dickene, M* & Williams ^ f% 1964* An eKperimen c a ] application of 
"gloie-' procedure and attitude measures tc listening 
coniprehension * Sgeeph Mono^raghs 31, lOJ^H. 

finkvlst; N.E. Kohonen, V. i^77.= C'l02e testing* gon^o theoretical 
and praotical aspects. In Zetuersten* A, (Ed,), 11-42. 

Enkvist, N,E, i Kohonen, V. (Eds,). To appoar 1978. Text 

Linguistics^ gognitive Theory _and Language TeachingV Turku i 
^nLA. 

Freadla, R.O, i Carroll/ J. B. (Eds.) 1972. Language Cgmprehension 
and the Acquisition of Knowled^^e . Washington, Q.C/t V*H, 
Winston" & Sons, 

GaieSi S.* Qradnfan* K. & Spolsky* 1977. Toward the rneasurement 
o£ functional proficiency ^ contextualiEation of the noise 
test. TESQL Quarterly 111 1, 51-7. 

Godfrey, D. 197t,. Listening instruction and practice for advanced 
second langi^age students. Language_Learning 27il, 109-22* 

Gradman, H*L- 197^* Reduced redundancy test ingi a reconsideration. 
In O'Brien, M^^^ (Ed.) 41-S* 

Gradnian, H*L* £ Spo^sky, B. 1975. Reduced redundancy testing: 
a progress report. In Jones ^ Spolsky (Eda.), 59-^70. 

Gregory-Fanopoulos i J.F^ 1966. An Experimental Application of 
"Cloze" Procedure as a Diagnoetic Test of Listening 
Comprehension an^ng Foreign Students. Diss. University of 
iouthern California. 

Harris, D,P. 1970, Report on an experiinontal group'^adml nlstered 
memory span test. TESQL Quarterly 4i3, 203^-13. 

HolErran,P* 1967, English language proficiency testing and the 
individual. Sejected Confercn^o Papers of the Aisociation 
of Teacher s o f ^^gjij h_ as _a S e co n f La ng^a ge ^6-84, Los 
Ai tos^ Calif or niaT Language Re s e a rc h As soSXi i te s Press. 

Hughes, G* 1974 * Aspects of listening coifprehension . Audio-Visual 
Language Journal 12i2^75-9. -— 

Johansson , 1972. Controlled distortion as a language testing 
tool. In Qvistgaard et al . (Eds.), 397-411. 

Johansson, S. 1973, An evaluation of the noise test. IRAL 11, 
107-34. ' ~~ 

K 

Jones, R^L. & Spolsky, B. (Eds.) 1975. Testing Language Proflc^tency 
Center for Applied LinguistiGe* • ~ 

Kohonen, V, 1576a. Kontekstin osuudesta vieramklelen oppimlsessa 
ja kielitaidon testaamisessa * In N'uirjnenmaa (Ed,), 23-43=. 

Kohonen, V. 1976b, Clo^e^testien ongelinia testianalyysin valossa* 
In Kohonen, V. lEd,), 31-54. . , 



20 



Kohonen, V. (Ed,) i976c, Integratiivlsen klel.tai don mlttaamlieita 
l^-o^e^testian .avulUi toori ja BovellukEla . Turku: 

Lado^ R, 1965.: Merrory span as a factor In second languncjc learning. 
IRAL , Vol. lit, 123-9. 

Lado, R* 1970. Language, thought and rnemory in language teaching; 
a thoufht view. The Modern Language _Journal LiVt 8, 580-5, 

Marslen-Wilson,^'. 197C. LinguLstic deecrlptions and psycholoqical 
assumptions in the study of sentence perei^ption, in Kalos s 
Walker (Eds. ) , 20'l-29, 

Massaroi D.W. 1975. Language and information process mq. In 
Massaro (Ed,) 1975, 3-28. 

Massarp, D.W. (Ed.) 1975. Understanding Language . New Vorkj 
Academic Press* 

Miller^ a. A. 1951. Language and Communication . New Vorki McGraw- 
Hill. 

Miller^ G.A. 1956. The magical number seven plus or irinus two. 
Psychological Review 63, 81-97. 

Mikkonen* V, i Mikkonen, J. 1971. OPSAMi opi ntosaavutusten 
mittaus . Helsinki j Tamni . 

^eisser, U. 1966. Cognitive Psychology . New Yorki Appleton- 
Century-Crofts. 



Kuryiienmaa, L. (Ed.) 1976 . Kieli, konteksti ja tilanne. AFinLAn 
svv^syrnposi umi 1975, Helsinki l AF inLA. 

Nutter, B. 1974, Presentation Methods, Deletion Patterns, and 
Passage Types for Use with Aural Cloze. Diss. UniS'ersity 
QZ Arizona, Dissertation Abstracts 1974, 35, 9^5-A. 

Nyglrd. A. k Nordstram* H, 1976. Tvl close test i svenskt 

intradesprov till Abo Akademi , In Kohonen, V, {Ed.}, 73-87. 

Oakes.-ott-'raylor , J. 1976, CIqz© pvocedure and foreign language 
listening skills. L.A.U.T. Series 

Q'Brien, M, (Ed*) 1973. Testing in Second Language Teaching i 

M^^mM^MM ^ Dublini ATESOL, 
uller, J.K. 1972. Contrastive analysis, difficulty, and 

predictability. Foreign Language Anna^ls 6, 95^106.' 

Oiler, J.W. 1976. Evidence for a general language proficiency 
factors an expectancy grarOTr, Die NQueren_ Spracjign 2/76, 
165-74. 

Oiler I j.W* k Richards, J.C, (Eds.) 19 7S. Focus on the Ligarneri 
Praan^t ic Perspec ti ves for the L anguage Teacher. Newbury 
House. 

Olle^ I J,W, & Streifi V. 1975. Dicta t ion i a te^t of grarr-.a r-based 
expeetancieg. Engli sh Language Teaching Journal XKxa, 25-36, 

Perren, G.E. k Trimi J.L,M, (Eds.) 1971= Applications of 

iiversit!i 



.Lina.uigtics. Carr^rldgei Cartridge University Press. 

Plmsleur, P. h Qulnn, T-, (Eds.) 1975. The PEychology p| Second 
Laniguage Learning . Cambridge^ Cambridge University Press. 



21 



QvlHtgaard, J. mt al . (Eds J ^972, AiLA Proeeedings 1972, Vol, ill , 
Heldelberf » 

Hlvers, w*M* 197^* LLnguistic and psychological ' factors in speech 
[j^CQBytion and their inpl icationB for teaching materials* 
In Finsleur i Quinn (Eds.), 123-34. 

Spllger, H*W^ & Whiteeon, 1975. Contextual iaing laboratory 
administered cdmprehenston tests ^ Sygtem , 3?ij 10-15. 

Sf.HtJlsky, B. et al, 1968, Preliminary studle?. m the dcvQlopment 
of techniques for tesLing overall succnd Umguagy 
proficitrncy . ^ n g u a ^ g j^r ri -L^-^_ j P ^ ^ ^ 1 1.' k u o N q 3 , 79^101, 

yijOisky, B* 1971, Reduced redundancy as a languaqe testing tool. 
In Perren i Trim (Eds*), 381-90, 

Spolsky, B. 1975. What does it mean to know a language | or how do 
you get someone to perforiTi htn compptcnce? In Oiler i 
Richards (Eds.), 164-76. 

Taylor / W, 1953. 'Cloze procedure* i a new tool for measuring 
Readability. Journalism Q^a^^erj^ , Frail 19^3, 415-33. 

Taylor* 1957. Cloze readability scores as indices of individual 
differences in comprehension and, aptitude. Journal of Applied 
Psychology XLI, 19-26. 

Templeton, H. 1977. A new technique for measuring listening 

comprehension. EnMlish Language Teaching Journal XXXI;4, 
2 92-9. — - - 

Wales ^ R.J, I Walker, E, 1976. New Ap prQache^ to^ Language 

Mechan inns . Afnsterdam etc North Hoi land Pljfal ishl^^ Co. 

Wanner, E. 1974. On Remembering, Forgetting , and Understanding 
S en tences . The Hague ^ Mouton. 

Whiteson, V* 1072* The correlation of auditory comprehension with 
general language profieiGncy. Audio^Vieual Language Journal 
^ 10: 2, 89-91 . . .„ 

WhitesQn, V, 1975* An integrative approach the. 'noise test". 
A ud i Q V i s ua 1 ^a n g u a Qg J o u r n a 1 13tl, IT-S , 

V/dld, A. H.197U, De CO d i n q _ 5 1 r a t e q i e s , _ _ Wp r d Open n e s g _a 0Q_ :t he 

Dimension o'£^Time in Oral ^^Jigjjj g^ Os lo ^ On i ve r s 1 ty~o f Os 1 o . 

Zettersten# A. (Ed,) 1977. ^jPflr5_0!\^_^nglish Language Testing in 
Scandinavia . Anglica et Arericana 1. Dep^. of English, 
: University of Copenhagen, 



22 



